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<^ ! This paper studies the problem of the deterministic version of the Verification Theorem for the 

optimal m-states switching in infinite horizon under Markovian framework with arbitrary switching 
cost functions. The problem is formulated as an extended impulse control problem and solved by 
means of probabilistic tools such as the Snell envelop of processes and reflected backward stochastic 
differential equations. A viscosity solutions approach is employed to carry out a fine analysis on the 
associated system of m variational inequalities with inter-connected obstacles. We show that the 
vector of value functions of the optimal problem is the unique viscosity solution to the system. This 
problem is in relation with the valuation of firms in a financial market. 
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'. 1 Introduction 



First let us deal with an example in order to introduce the problem we consider in this paper: 

Assume we have a power station/plant which produces electricity and which has several modes of 
production, e.g., the lower, the middle and the intensive modes. The price of electricity in the market, 
given by an adapted stochastic process {Xt)t>o, fluctuates in reaction to many factors such as demand 
level, weather conditions, unexpected outages and so on. On the other hand, electricity is non-storable, 
once produced it should be almost immediately consumed. Therefore, as a consequence, the station 
produces electricity in its instantaneous most profitable mode known that when the plant is in mode 
i G I, the yield per unit time dt is given by means of ipi{Xt)dt and, on the other hand, switching 
the plant from the mode i to the mode j is not free and generates expenditures given by gij{Xt) and 
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possibly by other factors in the energy market. The switching from one regime to another one is reahzed 
sequentially at random times which are part of the decisions. So the manager of the power plant faces 
two main issues: 

(i) when should she decide to switch the production from its current mode to another one? 
(a) to which mode the production has to be switched when the decision of switching is made? 

In other words she faces the issue of finding the optimal strategy of management of the plant. This 
issue is in relation with the price of the power plant in the energy market. 

Optimal switching problems for stochastic systems were studied by several authors (see e.g. [H [21 
131 11 El [ini [ni [121 [la [ni [201 [231 [M] and the references therein) . The motivations are mainly related to 
decision making in the economic sphere. Several variants of the problem we deal with here, including 
finite and infinite horizons, have been considered during the recent years. In order to tackle those 
problems, authors use mainly two approaches. Either a probabilistic one |101 [TTj \T7] or an approach 
which uses partial differential inequalities (PDIs for short) [T| [2l [4l [T2| [20l [24l [23] . 

In the finite horizon framework Djehiche et al. have studied the multi-modes switching problem in 
using probabilistic tools. For general stochastic processes, they have shown that a value of the problem 
and an optimal strategy exits. The partial differential equation version of this work has been carried out 
by El-Asri and Hamadene |13j . They showed that when the price process Xt is solution of a Markovian 
standard differential equation, then with this problem is associated a system of variational inequalities 
with interconnected obstacles for which they provide a solution in viscosity sense. This solution is bind 
to the value function of the problem. The solution of the system is unique. 

In the case when the horizon is infinite, there still much to do and this is the novelty of this paper. 
Actually, authors treat mainly the case when the price process Xt is of Markovian Ito type, the switching 
costs are deterministic functions of time t and the profit functions are deterministic functions of {t,Xt) 
and have linear growth at most (see e.g. [H [21 [121 [20l I24j). Therefore the main objective of this paper 
is to fill in the gap between finite and infinite horizon by providing a complete treatment of the optimal 
multiple switching problem in infinite horizon when the price is only a continuous process. This is 
what we did in the first part of this paper. Actually inspired by the work of Djehiche et al. [llj, using 
probabilistic tools such the Snell envelope of processes and BSDEs we provide a verification theorem 
which shapes the problem and then we have constructed a solution for this latter. This solution provides 
an optimal strategy for the switching problem. Later on, in the Markovian framework of randomness, 
i.e. in the case when X is a solution of a SDE, we show that with the value function of the problem is 
associated an uplet of deterministic functions {v^, . . . , v"^) which is the unique solution of the following 
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system of partial differential inequalities (PDIs for short): 

mm{vi{x) — max {— Qij (x) + Vj{x)),rvi{x) — Avi{x) — ipiix)} = 

iex-« (1.1) 

\/x G iR^ i G T = {l,...,m}, 
where A an infinitesimal generator associated with a diffusion process and X^* := {1, — l,i -\- 
l,...,m}. This system is the deterministic version of the Verification Theorem of the optimal multi- 
modes switching problem in infinite horizon. 

This paper is organized as follows: In Section 2, we formulate the problem and we give the related 
definitions. In Section 3, we introduce the optimal switching problem under consideration and give its 
probabilistic Verification Theorem. It is expressed by means of a Snell envelope of processes. Then we 
introduce the approximating scheme which enables to construct a solution for the Verification Theorem. 
Moreover we give some properties of that solution, especially the dynamic programming principle. 
Section 4 is devoted to the connection between the optimal switching problem, the Verification Theorem 
and the associated system of PDIs. This connection is made through backward stochastic differential 
equations with one reflecting obstacle in the case when randomness comes from a solution of a standard 
stochastic differential equation. Further we provide some estimate for the optimal strategy of the 
switching problem which, in combination with the dynamic programming principle, plays a crucial role 
in the proof of existence of a solution for (jl.ip which we address. In Section 5, we show that the solution 
of PDIs is unique in the class of continuous functions which satisfy a polynomial growth condition. In 
Section 6, we give some numerical examples. □ 

2 Assumptions and formulation of the problem 

Throughout this paper A; is a fixed integer positive constant. Let us now consider the followings 
assumption: 

HI: b : ]R}^ and a : M^^'^ are two continuous functions for which there exists a 

constant C > such that for any x, x' G M'' 

|6(x)| + |fT(x)| < (:7(l + |x|) and \a{x) - a{x')\ + \b{x) - b{x')\ < C\x - x'\ (2.1) 

H2: for i,j G X = {l,...,m}, gij : ^ ]R is a continuous function. Moreover we assume that 
there exists a constant a > such that for any x G IR!^ , 

^<9^J{x)<a, yi.jel, i^j. (2.2) 

is a continuous function of polynomial growth, i.e., there exist a 
constant C and 7 such that for each i €z I: 

<C{^ + \xr), e M''. (2.3) 
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We now consider the following system of m variational inequalities with inter-connected obstacles: 
V i G J 

min{uj(x) — max{—gij{x) + Vj{x)),rvi{x) — Avi{x) — V'i(a^)} = . (2-4) 
where T~* : = I — {i}, r is a positive discount factor and A is the following infinitesimal generator: 

^ = 5 E(-*),w^+E''.w^^ (2.5) 

i,j=l,k 1=1, fc 

hereafter the superscript (*) stands for the transpose, Tr is the trace operator and finally < x,y > is 
the inner product of x, y G iR*^. 

The main objective of this paper is to focus on the existence and uniqueness of the solution in 
viscosity sense of (12. 4p whose definition is: 

Definition 1 Let [vi, ...,Vm) be a m-uplet of continuous functions defined on , M-valued. The 
m-uplet {vi, ...,Vm) is called: 

(i) a viscosity supersolution (resp. subsolution) of the system \2.4^ if for each fixed i £ I, for any 
xo G and any function ipi G C^''^{1R^) such that (pi{xo) = Vi{xQ) and xq is a local maximum 
of (fi — Vi (resp. minimum), we have: 

min <^ Vi{xQ) - max (-^^^(xo) + Vj(xo)), 

I j62:-« (2.6) 

rv9i(xo) - Aipi{xQ) - ^iixo)} > {resp. < 0). 
(ii) a viscosity solution if it is both a viscosity supersolution and subsolution. □ 

There is an equivalent formulation of this definition (see e.g. [6]) which we give since it will be 
useful later. So firstly we define the notions of superjet and subjet of a continuous function v. 

Definition 2 Let v e C{1R''), X an element of IRI^ and finally Sk the set of k x k symmetric matrices. 
We denote by J'^'~^v{x) (resp. J'^'^v(x)), the superjets (resp. the subjets) of v at x, the set of pairs 
{q, X) e X Sk such that: 

v{y) < v{x) + {q,y -x) + \{X{y - x),y - x) + o{\y - xp) 
{resp. v{y) > v{x) + {q,y — x) + ^{X{y — x),y — x) + o{\y — xp)).n 

Note that ip — v has a local maximum (resp. minimum) at x, then we obviously have: 



{D^<^{x),Dl^(p{x)) eJ'^-v{x) (resp. j'^'+v{x)).a 



We now give an equivalent definition of a viscosity solution of the elliptic system with inter-connected 
obstacles (lOl). 



Definition 3 Let {vi, ...,Vm) be a m-uplet of continuous functions defined on and IR-valued. The 
m-uplet {vi, ...,Vjn) is called a viscosity supersolution (resp. suhsolution) of if for any i €z I, 

X £ and {q,X) £ J'^'~Vi{t,x) (resp. J'^'^Vi{x)), 

min\vi{x) — max (— 5fj,(a;) + f j(x)), r?jj(a;) Tr[a*Xa\ — {b,q) — ■ipi{x) \ > (resp. < 0). 

I jex-' 2 J 

It is called a viscosity solution if it is both a viscosity subsolution and supersolution .□ 

As pointed out previously we will show that system p.4p has a unique solution in viscosity sense. 
This system is the deterministic version of the verification theorem of the optimal m-states switching 
problem in infinite horizon which is well documented in in the case of finite horizon and which we 
will describe briefiy in the next section. 



3 The optimal m-states switching problem 
3.1 Setting of the problem 

Let ($7, J^, P) be a fixed probability space on which is defined a standard d-dimensional Brownian motion 
B = {Bt)t>o whose natural filtration is {J^^ := a{Bs,s < t})t>o- Let F = {J^t)t>o be the completed 
filtration of {J^f)t>o with the P-null sets of J^, hence {!Ft)t>Q satisfies the usual conditions, i.e., it is 
right continuous and complete. Furthermore, let: 

- V he the c-algebra on [0, +cxd) x of F-progressively measurable sets; 

- A4^''^ be the set of "P-measurable and iR'^-valued processes w = {wt)t>o such that E[j^°° \ws\'^ds\ < 
oo and 5^ be the set of "P-measurable, continuous processes w = {wt)t>o such that E[supf.yQ \'Wt\'^] < oo; 

- for any stopping time r G M^, TJ- denotes the set of all stopping times such that t < 9; 

- for any stopping time r, .7> is the cr-algebra on 17 which contains the sets A such that 
Ar\{T <t} £ for every t > 0. □ 

A decision (strategy) of the problem of multiple switching, on the one hand, consists of the choice 
of a sequence of nondecreasing stopping times (t„)„>i (i.e.r„ < r„_|_i) where the manager decides to 
switch the activity from its current mode to another one. On the other hand, it consists of the choice 
of the mode a r.v. J'v^ -measurable with values in X, to which the production is switched at r„. 
Therefore the admissible management strategies are the pairs (6,^) := ((T„,)n>i, (Cn)n>i) and we denote 
by V the set of these strategies. 

Let now X := {Xt)t>o be an 7^-measurable, iR'^-valued continuous stochastic process which stands 
for the market price of k factors which determine the market price of the commodity. On the other 
hand, assuming that the production activity is in mode 1 at the initial time t = 0, let {ut)t>o denote 
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the indicator of the production activity's mode at time t € JR'^ : 

Ut = l[o,r,]{t)+Y.(n^ir„,r„^,]{t). (3.1) 
n>l 

Then for any t > 0, the state of the whole economic system related to the project at time t is given by 
the vector: 

{t,Xt,ut) € M+ X M'' xl. (3.2) 

Finally, let il)i[Xt) be the instantaneous profit when the system is in state (t,Xt,i), and for i,j E 
2 i 7^ j, let gij{Xt) denote the switching cost of the production at time t from the current mode i 
to another mode j. When the plant is run under the strategy (6,^) = ((t„)„>i, (Cn)n>i) the expected 
total profit is given by: 

r+oo 

J{5,0 = E[ / e— ^„,(X,)ds - 5^e— "5n.„ ...J^.J]- 

^0 n>l 

Then the problem we are interested in is to find an optimal strategy, i.e, a strategy {5*,^,*) such that 
J{6*,n > J{S,0 for any {6,0 ^V. 

Note that in order that the quantity J{6, ^) makes sense we assume throughout this paper that 
for any i ^ I the processes {e~'^^iJji{Xt))t>o belong to A^^'"*^. On the other hand there is a bijective 
correspondence between the pairs ((5,^) and the pairs {6,u). Then throughout this paper one refers 
indifferently to (5, ^ or [6,u). 

3.2 The Verification Theorem 

To tackle the problem described above in the finite horizon case, Djehiche et al. [11] have introduced 
a Verification Theorem which is expressed by means of Snell envelope of processes which we describe 
briefly now. The Snell envelope of a stochastic process {r]t)t>o of 5^ (with a possible positive jump at 
+00 and lim rjt = M ^ L'^{^,J^,P)) is the lowest supermartingale R{r]) := {R{r])t)t>o of 5^ such that 
for any t > 0, R{r])t >Tjt. It has the following expression: 

\/t >{),R{7])t = esssupreTtE[rir\Ft\ (then it satisfles lim R{ri)t = M.) 

t— >+oo 

For more details on the Snell envelope notion on can see e.g. [71 1141 [T6] . 

The Verification Theorem for the m-states optimal switching problem in infinite horizon is the 
following: 

Theorem 1 . Assume that there exist m processes (y* := {Y^)t>o,i = l,...,m) of such that: 

Vt > 0, e-''*y/ = ess sup^>tE[r e-'''ipi{Xs)ds + e"^^ max (-5i,(X^) + Y^)\Tt], hm {e-''%') = 0. 

(3.3) 

Then: 
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(i) Yq = sup J((5, n). 

(<5,C)G» 

{ii) Define the sequence ofF-stopping times 6* = {T*)n>i follows : 
Tl = mf{s > 0, Yls = max {-gij{Xs) + F/)}, 

r* = mf{5>r*_i, = max (-<7„^. ^(X,) + y,'^)}, /or n > 2, 

n— 1 

• "^1* " max .)+y'=.)=-g„(X .)+y^.}; 

• /or any n>l and t > t*, y""" = ^ .=j]y/ 

• /or any n > 2, n^-* = / on the set 

T/ien i/ie strategy {8*,u*) satisfies -£'[X]n>o ^~^"^'*] ^ "^^^ optimal i.e. J{6*,u*) > J{6,u) 
for any (6, u) ^T). □ 

Proof. The arguments of this proof are standard, based on the properties the Snell envelope. We defer 
the proof in the Appendix. □ 

The issue of existence of the processes y^, ...jy*" which satisfy (j3.3p is also addressed in pTj. For 
n > let us define the processes (y"'^, ...,Y'^''^) recursively as follows: for i G X we set, 

/+00 
e-"Vi(^s)tZs|^t], t > 0, (3.4) 

and for n > 1, 

^-rtynA ^ sup,>ti^[ r e-''ij,iXs)ds + c'^^ max (-g^kiXr) + * > 0. (3.5) 

Jt kei-^ 

Then the sequence of processes ((y"'^, y"'''"))n>o have the following properties: 

Proposition 1 /^f77]/. Pro. 5 anrf Th.2) 

(i) /or any i G X and n>0, the processes y"'^, ...,Y'^''^ are well-posed, continuous and belong to S"^ , 
and verify 

r+oo 

yt>0, <e-'%''+^'' <E[ e-'''{max\i;i{Xs)\}ds\J^t]] (3.6) 

Jt i=l,m 



(a) there exist m processes Y^, Y"^ of S'^ such that for any i G I: 

(a) Vt > 0, y/ = lim„^oo / ^t"'' 
(6) Vt > 0, 

e-'-'Y^ = ess sup,>^E[ f e-'^>i(X,)ds + e"''^ max {-gik{Xr) + Y^)\Tt] (3.7) 
Jt kei-' 

i.e. y-^,...,y™ satisfy the Verification Theorem[l\ ; 

(c) Vt > 0, 

/•+00 

e-^'Y^ = esssup^s,0^^iE[ / e— Vn. - ^ e— " <7..„_,n.„ (^rJl^t] (3.8) 

n>l 

where Vl = {((5,^) = ((t„)„>i, (^n)n>i) such that uq = i and ti > t}. This characterization 
means that if at time t the production activity is in its regime i then the optimal expected 
profit is Yl . 

(d) the processes Y^, Y"^ verify the dynamical programming principle of the m-states optimal 
switching problem, i.e., \/t < T , 

e-'-'Yl =esssup^^,.,-^^T,.E{r e-''^^XX,)ds- ^ e-^^'=<7„.^,_^,,jX,J + 6"'^-"^,:- 

\<k<n 

(3.9) 

Note that except {ii — d), the proofs of the other points are the same as in [llj in the framework of 
finite horizon. The proof of {ii — d) can be easily deduced in using relation ()3.7p . Actually from ()3.7p 
for any i £ I, t > and (5, ^) G T>1 we have: 

e-^''Yl>E[r e-^^^l:uSXs)ds- J] '=g„,^_^„„^jX.J + (3.10) 

l<fc<n 

Next using the optimal strategy we obtain the equality instead of inequality in p.lOp . Therefore the 
relation (13. 9D holds true. □ 



Remark 1 The characterization 113. 8\) implies that the processes Y^ , ...,Y"^ of S"^ which satisfy the 
Verification Theorem are unique. 

4 Existence of a solution for the system of variational inequalities 

4.1 Connection with BSDEs with one reflecting barrier 

Let X G Br& and let be the solution of the following standard SDE: 

dX^ = b{X^)dt + a{X^)dBt, X^ = x (4.1) 
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where the functions b and a are the ones of HI. These properties of a and b imply in particular that 
solution of the standard SDE ()4.ip exists and is unique in M^. The operator A defined in (j2.5p is 

the infinitesimal generator associated with X^. 

In the following result we collect some properties of X^. 

Proposition 2 (see e.g. ]22^) The process X^ satisfies the following estimates: 

(i) For any q > 2 there exists Cq such that, 

|«] < Cqe^''\l + \x\'i) Mt > 0. (4.2) 

(m) There exists a constant C such that for any x, x' E and T > 0, 

E[ sup \X^ - Xf < Ce^^\x - .□ (4.3) 

0<s<T 

In the sequel we consider the following condition: 
H4: Assume 7 > 2 and 

-r + C^<0, (4.4) 
where 7 is the growth exponent of the functions ipi and is the constant in ()4.2p . □ 

Remark 2 .• // 7 < 2, there exists a constant 71 > 2 such that 71 verifies the growth exponent of the 
functions tpi. 



We are going now to introduce the notion of a BSDE with one reflecting barrier considered in }19] . 
This notion will allow us to make the connection between the variational inequalities system (j2.4l) and 
the m-states optimal switching problem described in the previous section. 

Let us introduce the pair of process {Y^, Z^) G 5^ x Ai^'"^ solution of the following BSDE: 

= YS+ r F{Xf,Yi', Zf)dl - r ZfdBu for aU T > and t < T, (4.5) 

J s J s 

where F : IR^ x M x M'^ M is continuous and satisfies: there exist a continuous increasing function 
(p : iR+ and constant K, K', ^ < 0, p > such that, 

\F{x,y,z)\ <K'{l + \x\P + ^{\y\) + \z\), 

{y - y', F{x, y, z) - F{x, y' , z)) < fi\y - y'p, (4.6) 
\F{x,y,z)-F{x,y,z')\ < K\\z - z'\\. 

We assume moreover that for some A > 2^ + K2, 

r+00 

E[ e^^|F(Xf=,0,0)|2(is] < +00, (4.7) 
Jo 



which essentially implies that A + 6*2-^ < 0. 

Let us consider the following semilinear elliptic PDE in IB!^: 

)*Vu{x)) = 0, X G ]R^. (4.8) 

Then we have the following result: 

Theorem 2 ( \21^ , Th. 5.2) Under the above assumptions, u{x) = Yq is a continuous function and it 
is a viscosity solution of i4-^ which satisfies, 



/ r+oo 

m < cJe[ e^-|F(X-,0,0)P<is], (4.9) 

for any A > 2/i + K2.n 

Let us now introduce the following functions: 

(i) / : iR^ — > iR is continuous and of polynomial growth, i.e., there exist some positive constants C 
and 7 such that: 

\f{x)\ < C(l + |xP), Vx E iR^ (4.10) 

[ii) h : — > iR is continuous and bounded. 

Then we have the following result related to BSDEs with one reflecting barrier: 

Theorem 3 For any x G IR!' , there exits a unique triple of processes {Y^ , , K^) such that: 

Y^ , G 5^ and € TW^''^; is non- decreasing and K§ = 0, 
, e-'sy- = J+°^e--^f{Xf)dl- 1+°° ZfdBi + Kl^-K^, (4.11) 
g-rsyx > e-'^'hiX^), Vs > and /o^°°(e^'"'y,^ - e'''^h{Xf))dKf = 0. 

Moreover the following characterization of Y^ as a Snell envelope holds true: 

"^syO, e-^'^Yf = esssupreTsE[f e^''7(^f )d^ + e"^^/i(X^)|.F,]. (4.12) 

J s 

On the other hand there exists a deterministic continuous with polynomial growth function u : Br& — > 
M such that: 

G ]R^ Y^ = u{x). 

Moreover the function u is the viscosity solution in the class of continuous function with polynomial 
growth of the following PDE with obstacle: 

min{u(x) — h{x),ru{x) — Au{x) — /(x)} = 0. (4-13) 
10 



Proof: Existence and uniqueness of the triple (Yf , Zf , Kf)f>Q of (|4.1ip follow from Theorem 3.2 in 
|19j . Now we consider the infinite horizon BSDE: 

/•+00 r+OD r+OD 

nyx^-rs ^ / e-''^f{Xf)dl - / + / ne-^'^Y;^ - h{Xf))-dl. (4.14) 

o S S S 

From Theorem 1 in [5j there exists a unique solution ("y^,Z"'^) G 52 X M'^^'^ satisfying the BSDE 

(imi) . 

Next let us define 

E:^"'^= r ne-^'^CYl' -h{Xf ))-dl, 
Jo 



then 



j+00 ^-ri^nyx _ ^xf) A" Yf')dK"''' = Ti e-^'("l^^ - h{Xf) A" y,^)e-'''("yf - h{Xf))-dl 

= 0. 



Since iiT"'^ is non-decreasing and Kq ' = 0, we rewrite Eq. (|4.14|) in RBSDE form 

nyx^-rs ^ J+oo ^~rlf^xf)dl - /+~ Z^'^^dBi + K^f - 

nyxg-rs > e-^^(/i(X3^) A" ), Vs > and j^"^ e-'''("yf - h{Xf) A" Yf')dKf = 0. 
Then from property (j4.12p we have: 



(4.15) 



"y-e"'-^ = esssupre%E[J^ e-''^f{Xf)dl + e-'-'C^F," A /i(X^))|.F,]. (4.16) 
Note that if we define 

fn{t, X, y, z) = e~''^f{x, y, z) + ne~''\y - h{x))~ 

fn{t,x,y,z) < fn+i{t,x,y,z). 

Then it follows from the comparison Theorem 2.2 in [T^ nyx^-rs ^n+i Yfe~^'^, s > 0, a.s. and from 
(|4.12p and (j4.16p ^Y^e~^^ < Y^e~^^. This implies that there exits a cadlag process {Y^)s>o such that 
P — a.s. for any s > 0, 

"y/ e"" T e-"yf , a.s. 



Let us actually show that Y^ is cadlag . By (j4.16p . for any n > 1, the process ("■Yf + e~''"'^ f{Xg)ds)t>o 

is an F-supermartingale which converges increasingly and pointwisely to {Yf + e~^'^ f{Xg)ds)t>o- 
Therefore, the limit is also a cadlag F-supermartingale (see e.g. Dellacherie and Meyer (1980), pp. 86). 
Hence, the process Y^ is cadlag . 

Then it follows from Proposition 2 in [11], as re — > -|-oo, 

Yfe-"-' = esssup^^rM f e~'-^f{Xf)dl + e-'-^{Yj^ A h{X'^))\Ts\. (4.17) 

J s 
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From (|4.14p we have: 

^[/+°° e"'^^("y;^ - h{Xf ))-dl] = e-^^ + /+°° e-''^f{Xf)dl] 

< ii?[|y/e— I + /+°° \e'''f{Xf)\dl] 



for a constant C independent of n and H4. Then 

»+oo 



r+oo /~f 

E[ / e-'^'("Y,^ - h{Xf ))-dl] < —. 
Js n 



Hence as n — > +00 we obtain, E[j^'^ e '^^{Yf — h{Xf)) dl] = 0, and since {Y^)s>o (resp. h{x)) is a 
cadlag process (resp. continuous), we have 

Yt^ > HXf). (4.18) 

From KT2\\ . KTl\\ and KTEh we get: 

Yf = Y^ yt > 0. 
Now rewrite Eq. (I4.14p in differential form 

^(nyxg-rs) ^ _[g-rs^(^x) ^ „e~^'s(ny^x _ h{X^^))~]ds + Z^'^^dB^. 

So for arbitrary T > and < s < T, Eq. ()4.14p is equivalent to 

nyx =n _^ j-J[(/(xf ) + n("l^^ - /i(Xf ))~) - r"'Y{']dl - Zj^'^'dBi, (4.19) 
with Z^'^ = Z^'^e^^. Let us set Fn{x, y, z) = f{x) + n(y — h{x))^) — ry. 

In order that it satisfies the assumptions of Theorem [21 we just need to verify that Fn satisfy condition 
()4.6p and ()4.7p . It is obvious that F„ satisfy ()4.6p where /i > — r, and we show that F„ satisfy ()4.7p . 
Prom the polynomial growth of / and since h bounded and estimate (j4.2p . we deduce 

i5^[/o'°'e^1i^n(X-,0,0)|2ds] =i?[/+~e^^|/(X-)+n(-MX,-))-prf^] 

< 2E[j^^ e^^((l + |X,^P)2 + n^C2)ds\ 

< C/o+°°e^^e^2^^(|x|2^ + n2)ds, 
for A + 6*27 < 0. This proves assumption (j4.7p . Then 

and is a viscosity solution of the elliptic PDE 

AUn{x) + Fnix, Unix), a{x)*V Unix)) = 0. 

We now define 

uix) = Y^, Vx G iR^ 
which is a deterministic quantity. Let us admit for a moment the following Lemma: 
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Lemma 1 The function u is continuous in .O 

From the previous results we have, for each x G iR'^, 

Un{x) t u{x) as n — > +00. 

Since Un and u are continuous, it fohow from Dini's theorem that the above convergence is uniform on 
compacts. 

We now show that li is a subsolution of (j4.13p . Let x be a point at which u{x) > h{x), and let 
{q,X) G J^'+n(x). From Lemma 6.1 in [6], there exists sequences: 

Uj ^ +00, Xj ^ X, {qj,Xj) £ j'^'^UnjiXj), 

such that 

{qj,Xj)^{q,X). 

But for any j, 

-^Tr[a*Xja] - {b,qj) - Fn{xj,Un^{xj), a{xj)*Vun^{xj)) < 0, 
-^Tr[a*Xja] - {b,qj) - f{xj) - nj{un^{xj) - h{xj))~) +run^{xj) < 0. 

From the assumption that u{x) > h{x) and the uniform convergence of Un, it follows that for j large 
enough Unj{xj) > h{xj). Hence, taking the limit as j — > +00 in the above inequality yields: 

-^Tr[a*Xa] - {b, q) - f{x) + ru{x) < 0, 

and we have proved that n is a subsolution of ()4.13p . 

We now show that u is a supersolution of (14.130 . Let x be arbitrary in M^, and {q, X) G J^'~n(x). We 
already know that u{x) > h[x). By the same argument as above, there exist sequences: 

nj—> +00, Xj X, {qj,Xj) £ j'^'^Unjixj), 

such that 

{qj,X,)^{q,X). 

But for any j, 

^Tr[a*Xja] - {b,qj) - Fn{xj,Un^{xj),a{xj,i)*Vun^{xj))) > 0, 



2 

■^Tr[a*Xja] - {b,qj) - f{xj) - nj{un^{xj) - h{xj))-)+rUn,{xj) > 0. 

Hence, 

-]^Tr[a*Xja] - {b, qj) - f{xj) + run^ixj) > 0, 
13 



and taking the limit as j — > +00, we conclude that: 

~^Tr[a*Xa] - {b, q) - f{x) + ru{x) > 0. 
We conclude by showing that u is of polynomial growth. From (|4.12|) we have, 

|l^o1 <supr>oE[£e--ViXs)\ds + \hiX-)\l[,^+^^] 

< supr>oE[£ e-^ViXs)\ds + e— (4.20) 
<E[f+^e-^ViX-)\ds]+Ci. 
Prom polynomial growth of / and u{x) = Y^, we deduce that u is of polynomial growth. Now we 
proceed to the proof of Lemmel. 

Proof of Lemma 2. It suffices to show that whenever x„ x, \Yq" — Yq\ 0. 
From (|4.12|) we have, 

Fo" = supEiT e-''f{Xndl + e-'-^h{X^)], 
tgTq Jo 

Y^- = sup E[ r e-'^f{X'f-)dl + e-""/i(X^")] 
reTo Jo 

then, 

\Y^--Y^\ < snvE{j;e-^y{Xf-)- f{Xf)\dl + e~'^^\h{X^,-)-h{Xm 

(4.21) 

< i?[/+°°e-'|/(Xf") - /(Xf)|d/] +i?[supe-*|/.(Xf") - h{Xf)\]. 

t>o 

In the right-hand side of ()4.2ip the first term converges to as — > x. Next let us show that, 

~T't I L / \7'Xyi \ { 'V'X \ 



S[supe-^*|/i(Xf") - h{Xf)\] ^0 as x„ ^ x. 



For any T > we have 



E[supe-^'\h{Xn - HXm < E[ sup e-^'lKX^ " /i(Xf )|] + i^[sup e^XX,^'") - /i(Xf)|]. 

t>0 Q<t<T t>T 

Since h is bounded there exists C such that, 

E[supe-^'\hiX^-)-hiXf)\]<E[ sup e-'-*|/i(Xf") - M^f )|] + Ce"^^. 

t>0 0<t<T 
For any p > we have: 

i?[sup e-%iX^") - h{Xf)\] =E[snp e-'^*|/i(Xf") - ^Xf )|l[,,p |^.„l+,,p l^.|<^]] 

0<t<T 0<t<T t<T t<T 

+E[ sup e--%{X^")-h(Xm[sup\xr\+sup\Xf\>p]]- 

0<t<T t<T t<T 

But since h is continuous then it is uniformly continuous on compact subsets, then there exists tt : 
^ R increasing with 7r(0) = 0, such that: 

iMxr)-M^r)i<vr(ixr"-xri), 
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we have 

E[ sup e-'^*|/i(Xf") - /i(Xf)|l[,„p|^.n|+,„p|^.|<^]] < E[ sup 7r(|Xf" - Xf |)l[,,p |^.„l+,„p l^.|<^]] 

0<t<T t<T t<T 0<t<T t<T t<T 

<E[tt{ sup l^f" -Xf|)l[sup|X,""| + sup|Xf|<p]]• 
0<t<T t<T t<T 

Using the continuity proprety (|4.3p . 7r(0) = and the Lebesgue dominated convergence theorem to 
obtain that 

E[ sup e-'^*|/i(Xf") - /i(Xf )|a[3,p ix^^'^i+sup |Xf |<p]] ^0 as x„ ^ x. (4.22) 

0<t<T t<T t<T 



The second term satisfies: 



sup e-^*|/i(X,^")-/i(Xf)|l[,,p[^.„[+,,p|^, 



0<t<T 

<i?[ sup e-2-*|/i(X,-")-/i(^f)P]}^{i?[l[sup|x-|+sup|Xf|»p]]}^ 

0<t<T t<T t<T 

<^[{ sup e-2'^*|/i(Xi^") - /i(Xf p-iE[sup|Xf"| + sup |Xf|]}i 

0<t<T t<T i<T 

Since h is bounded, it follows that, when x„ — > x, the right-hand side of the last inequality is smaller 
than p~2Cx- However, from previous results we have, 

limsupE[supe-^Xx;"") - h{X^)\] < p-^C^ + Ce"^^. 

x„^x t>0 

As p and T are arbitrary then making p — > +oo and T — > +oo to obtain that, 

lim S[supe-''*|/i(Xf") - h{Xf)\] = 0. (4.23) 
From (OTD and (03]) . we deduce 

{Y^'^-Y^l^O as Xn^x.D 

4.2 Existence of a solution for the system of variational inequalities 

Let (y/'",...,yr'")s>o be the processes which satisfy the Verification Theorem [1] in the case when the 
process X = X^ . Therefore using the characterization (j4.12p . there exist processes K^'^ and Z*'^, such 
that the triples (y^'^ , Z^'^ , K^'^) are unique solutions (thanks to Remark [2]) of the following reflected 
BSDEs: for any i = 1, ...,m we have, 

y*'^, K^'^ £ 5^ and Z*'^ G A^^''^; i^*'^ is non-decreasing and Kq '^ = 0, 

^-rsyp- = J+°o e-r^^,(Xf)ds - /+°° Zl'^'dBi + K'f^ - , s G 1R+, Jm^(e— y/'") = 0, 
^-rsyp^ > -e-" max {-gij{Xf) +Yi'''), s € M+, 
^+00 _ ) + y/.-'))di^;.- = 0. 

(4.24) 

Moreover we have the following result. 
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Proposition 3 There are deterministic functions v^, ...,v"^ : IR^ M such that: 

Vx e iR^, Y^^'"" = v\x), i = 1, m. 
Moreover the functions v\ i = I, ...,m, are of polynomial growth. 

Proof: Forn > let (^^'^'^ .., y."'"'^),>o be the processes constructed in (I3.4p - ()3.5p . Therefore using 
an induction argument and Theorem 2 there exist deterministic continuous with polynomial growth 
functions t;"'* (i = 1, ...,m) such that for any x G M^, Y^'^'^ = Using now inequality (|3.6p we 

get: 

r+oo 

Yn,t,x ^ ^ / | ^^^^ | e"^^ V'* (^s ) I 

since Y^"'*'^ is deterministic. Therefore combining the polynomial growth of ipi and estimate (j4.2p for 
we obtain: 

v'^'^x) < v''+^'\x) < C(l + IxD 

for a constant C independent of n. In order to complete the proof it is enough now to set := 
lim^^oo ^^"''n^)) ^ ^ -^'^ since y"-*-^ ^ y*-^ as n — > oo. □ 

We are now going to focus on the continuity of the functions v^, ...,v"^. But first let us deal with 
some properties of the optimal strategy which exist thanks to Theorem 1. 

Proposition 4 Let {5,u) = ((t„)„>i, (^„)„>i) be an optimal strategy, then there exists a constant C 
which does not depend on t and x such that: 

Vn > 1, E[e-''^^] < (4.25) 

n 

Proof: Recall the characterization of (|3.8p that reads as: 

^o'" = sup(^s,u)evE[f,'-°^ e-^^i^uAX^)ds - Efe>ie-''"^-9n.,_,«.,(^^J]. 
Now if ((5, n) = ((t„)„>i, {(,n)n>i) is the optimal strategy then we have: 

Taking into account that gij > ^ > for any i j we obtain: 

But for any k < n, e"'''^" < e"*"^*^ then: 
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and then 

^i?[e"-"] < e— I i^uAXf) I ds] - yj'" 

Finally taking into account the facts that ipi and Y^'^'^ are of polynomial growth, estimate (j4.2p for 
and H4 to obtain the desired result. Note that the polynomial growth of g^^gj^g from Proposition 

3. □ 



Remark 3 The estimate \4-2^() is also valid for the optimal strategy if at the initial time the state of 



the plant is an arbitrary i £ Z. O 

We are now ready to give the main result of this article. 

Theorem 4 The functions {v^, ...,v"^) : — > M are continuous and solution in viscosity sense of the 
system of variational inequalities with inter- connected obstacles ^2.4^ . 

Proof: First let us focus on continuity and let us show that vl is continuous. The same proof will be 
valid for the continuity of the other functions (i = 2, ...,m). First the characterization (j3.8p implies 
that: 

f+oo 

Y^'' = sup E[ e— Vn.(Xf)ds- J]e— ,n.jX^J] 

mev Jo 

On the other hand an optimal strategy (S*,^*) exists and satisfies the estimates (j4.25p with the same 
constant C. Next let e > and x' G B{x, e) and let us consider the following set of strategies: 

D := {(<5,0 = ((r„)„>i, (e„)„>o) G V such that Vn > l,E[e-'^-'^] < £ii±ii±M!))}. 

~ ~ n 

Therefore the strategy (5*,^*) belongs to D and then we have: 



and 



^0 = ^^V^5,0eD E[Io^^ e-^^i;.Mf)ds - E„>i e"^"- [X^] 
= ^uPi5,u)eDE[Io''e-''^uAXf)ds 

The second equalities it due to the dynamical programming principle. It follows that: 



"TC I J T-„ T, 



< i?[/+~max,=i,^e— ) - i^j{X^)\ds 

+nmaxi^jgi{sups>oe"''^|5'ij(Xf ) - gij{X^)\}] 
+snp(,_,),^(i?[e-2-"])l(2i?[(y-"'^')2 + (y.:-'^)2])i 



(4.26) 
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In the right-hand side of (j4.26p the first and the second term converges to as x' — > x. 
Now let us focus on the last one. Since {6, u) €z D then: 

< n--2 sup(,^„),^(2ii;[(0'"')2 + (0'")2])l 

< Cn-i(l + |x|T + |xp) 

where C an appropriate constant which comes from the polynomial growth of ^j, i £ I, estimate (j4.2p 
for the process and inequality (|3.6p . Going back now to (j4.26p . taking the limit as x' — > x to obtain: 

lim lYf^'""' -Yf^'""] < Cn-^(1 + 2|xp). 

As n is arbitrary then putting n +00 to obtain: 

^0 ~^ ^0 ■ 

Therefore is continuous. In the same way we can show that v'^,...,v"^ are continuous. As they are 
of polynomial growth then taking into account Theorem 2 to obtain that (f-'^, . . . , i'™') is a viscosity 
solution for the system of variational inequalities with inter-connected obstacles (j2.4p . □ 

5 Uniqueness of the solution of the system 

We are going now to address the question of uniqueness of the viscosity solution of the system ()2.4p . 
We have the following: 

Theorem 5 The solution in viscosity sense of the system of variational inequalities with inter- connected 
obstacles \2.4^ is unique in the space of continuous functions on which satisfy a polynomial growth 
condition, i.e., in the space 

C := {ip : M, continuous and for any 

X, \ fix)\ < C(l -|- |x|''') for some constants C and 7}. 

Proof. We will show by contradiction that if ui, ...jUm and wi, ...^Wm are a subsolution and a super- 
solution respectively for (j2.4p then for any i = 1, ...,m, Ui < Wi. Therefore if we have two solutions of 
(j2.4p then they are obviously equal. Actually for some R > suppose there exists (xo,io) £ Bji x I 
{Br := {x G M''; \x\ < R}) such that: 

max(ui(x) - Wi{x)) = Uio(xo) - Wioixo) = rj > 0. (5.1) 

{x,i) 

Then, for a small e > 0, and 0,X £ (0,1) small enough, let us define: 

$:(x, y) = u,{x) - (1 - X)w^{y) - - vf^ - e{\x - xof^+^ + \y - xoP^+'). (5.2) 
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By the polynomial growth assumption on Ui and Wi, there exists a (x^, y^, i^) € B^i x Bji x T, such that: 

^i'{xe,ye) = max <^l{x,y). 
On the other hand, from 2$*"= (a;^, y^) > <^>*^(xe,Xe) + we have 

- yeP^ < - Ui^iVe)) + (1 " A)(wi^(x,) - u;i,(ye)) 

(5.3) 

< Yl \UiiXe) - Ui{ye)\ + (1 - A) X] \Wi{Xe) - Wi{ye)\ 

and consequently ^Ix^ — y^l"^^ is bounded, and as e ^ 0, — y^l 0. Since Ui and Wi are uniformly 
continuous on Bji, then — T/e^''' ^ as e — > 0. 
Since 

«io(2;o) - (1 - >^)Wio{xo) < ^l'{x,,ye) < UiSXe) " (1 " X)WiXye), 

it follow as A — > and the continuity of Ui and Wi that, up to a subsequence, 

^ (2;o,2;o,«o)- (5.4) 

We now claim that: 



Indeed if 



Ui^{xe) - max {-gi^j{xe) +Uj{xe)} > 0. (5.5) 



Ui^{xe) - max {-^^^^(xj + Uj{x^)} < 



then there exists k ^ I '•^ such that: 

UiS^e) < -gi,k{Xe) +Uk{Xe). 

From the supersolution property of Wi^ {ye), we have 

WiAVe) > max {-gi^j{y^) +Wj{ye)) 

then 

Wi^iye) > -gi,k{ye) + Wk{ye)- 

It follows that: 

UiXxe) - (1 - X)wi^{ye) - {uk{xe) " (1 " A)u;fc(y,)) < (1 - X)gi,k{ye) - g^kixe)- 
Now since > a > 0, for every i 7^ j, and taking into account of (|5.2p to obtain: 

^>*/(xe,ye) - ^>e(a:e,ye) < "oA + ^j^fc (y,) -5j,fc(a;e) 

But this contradicts the definition of i^, since Qi^k is uniformly continuous on Bn and the claim (j5.5p 
holds. 
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Next let us denote 



^,ix, y) = -\x- + ei\x - xo|2^+' + \y- xo|'^+'). 



2e 



Then we have: 



D,^,{t, x,y) = ^{x- y)\x - y\^^-^ + 9{2^ + 2)(x - xo)\x - xq^t, 
Dy^,it,x,y) = -^{x - y)\x - y\^^-^ + 9(2^ + 2){y - yo)\y - yo\^\ 



< B{t,x,y) = Dlyip^{t,x,y) = I 



ai{x,y) -ai{x,y)\ I a2{x) 



-ai{x,y) ai{x,y) 



+ 



a2{y)^ 



(5.6) 



(5.7) 



with. ai{x , y) = j\x — y\'^^ ^1 + 7(27 — 2)(x — y)(x — y)*|x — yp"^ ^ and 
^ a2{x) = e{2j + 2)|x - xopTJ + 2^7(27 + 2)(x - xo)(x - xo)*|x - xq^^-^. 

Taking into account ()5.5p then applying the result by Crandall et al. (Theorem 3.2, [6]) to the function 

Ui{x) - (1 - X)wi{y) - ipe{x,y) 



at the point (xe,ye), for any ei > 0, we can find X,Y £ S^, such that: 



(^(xe - y.)|x, - 2/,|27-2 + ^(27 + 2)(x, - xo)|x, - XoP^X) G j2'+(ni,(x,)), 
(^(x, - y,)|x, - y,|27-2 _ 0(27 + 2)(y, - yo)|ye - yo\'\ Y) G j2.-((l - A)u;,,(2/,)), 

-(i + ||i?(xe,ye)||)/< <i?(x„y,)+eii?(x„y,)2. 

Taking now into account (|5.5|) . and the definition of viscosity solution, we get: 

rui^ix,) - lTr[a*{x,)Xa{x,)] - (^(x, - y,)|x, - y,|27~2 

+0(27 + 2)(x, - xo)|x, - xop7, 6(xe)) - ^^^^Sxe) < and 
r(l - A)«;.,(y,) - irr[a*(y,)ycT(ye)] - (?(xe - y.)|xe - yeP^"' 

-e(27 + 2)(y,-xo)|y.-xo|2^6(y,)) -(l-A)V'i,(y,) >0 

which implies that: 

ru^^{xe) - r{l - X)wM < lTr[a*{x,)Xa{x,) - a*{ye)Yaiye)] 
+(f (x, - y,)|x, - y,|27-2, 6(x,) - b{y,)) 

+(0(27 + 2)(x, - xo)|x, - xo|2^ 6(x,)) + (0(27 + 2)(y, - xo)|y. - xqP^, 6(y,)) 
+V»,(xe)-(l-A)V»,(y.). 

But from (15. 7p there exist two constants C and Ci such that: 

||ai(x„y,)|| < C|x,-y,|2T-2 and (||a2(x,)|| V ||a2(ye)||) < Ci9. 



(5.8) 



(5.9) 
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As 

1/ ai{xe,ye) -ai{x^,y^)\ ^ I a2{xe) 

ai{xe,ye) ai{x,,y^) / \ a2(ye)^ 



S = B{x^,y, 
then 



It follows that: 



B<- \ I \ + CiOI. 



S + eiS2<C(-|x,-y,|2T-2 + fi|a;,-y,|47-4) [ ^ ^ \ + Ci9I (5.10) 



where C and Ci which hereafter may change from line to line. Choosing now ei = e, yields the relation 
B + e,B2 < j{\x, - + \x, - y,|47-4) |^ | + c-i^/. (5.11) 

Now, from HI, and (f5lT|) we get: 

^rr[a*(x,)Xa(x,) - a*{y,)Ya{y,)] < -{\x, - y,f^ + |x, - y,\'^-^) + Cid{l + \x,f + \yf). 



Next 



and finally, 

(0(27 + 2)(xe - xo)|x, - xoP^ 6(x,)) < eC{l + \x,\)\x, - xoP^+^ 

(0(27 + 2)(y, - xo)|ye - xol'^ 6(y.)) < eC{l + \y,\)\y, - xoP^+^ 

So that by plugging into (j5.9p we obtain: 

™,^(x,) - r(l - A)u;i,(y,) < f (|x, - y,\''^ + - y,|47-2) + Ci0(l + + ly^P) + ^jx, - 
0C(1 + |x,|)|x, - xoP^+i + 0C(1 + |y,|)|y, - xqP^+i + ^,^(x,) - (1 - 

By sending e— >0, A— >0, 0^0 and taking into account of the continuity of ^i^, we obtain ^^^(xo) — 
Wi^{xQ) < which is a contradiction. The proof of Theorem is now complete. □ 

As a by-product we have the following Corollary: 

Corollary 1 Let (v^ , ...,v"^) be a viscosity solution of \2.4^ which satisfies a polynomial growth condi- 
tion then for i = 1, m and {t, x) G , 

f+00 

v\x)= sup E[ e-^-^^I^^AXt)ds-Y,^-^'^''9u.^ ,u.SKJ]- 

{^m-Di Jo „>i 
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6 Numerical results 

We consider now some numerical examples of the optimal switching problem \2.4^ . 

Examplel; In this example we consider an optimal switching problem with two modes, where 

r = 100, b = X, a = \f2x, gi2{x) = \\x\ + 0.1, g2i{t,x) = \x\ + 0.48, = - 0.3x + 1, 

1p2{t,x) = + 1. 

2.5 r 




2 4 6 8 10 12 14 



Figure 1: Curves of and v^. 

Example2.- We now consider the case of 3 modes where r = 100, b = x, a = \plx, gi2{t,x) = 
0.5\x\ + 1, gi3{t,x) = x'^ + 0.5, 521(^,2;) = \x\ + 4, g23{t,x) = \x\ + 5, g3i{t,x) = 0.001|x| + 0.1, 
532(i, x) = x'^ + \x\ + 0.5, ipi{t, x) = X + 1, ^2it, x) = —X — 2 and finally Tps^t, x) = —x — 2. 

Acknowledgement: The author thanks gratefully Prof. S. Hamadene for the fructuous discussions 
during the preparation of this paper. □ 
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Figure 2: Curves of v^, and v'^. 

Appendix: proof of Theorem 1 

The proof consists in showing that for any t < T, , as defined by (j3.3p . is nothing but the expected 
total profit or the value function of the optimal problem, given that the system is in mode i at time t. 
More precisely, 

/ + 00 
fe>i 

where T>t is the set of strategies such that ti > i, P-a.s. if at time t the system is in the mode i. 
Let us admit for a moment the following Lemma. 

Lemma 2 For every t > t^. 

e-'-% ^1 = ess sup,>tE[ / e^'^^^^, {Xs)ds + e-"-^ max {-g^J{Xr) + Y^)\J^t].0 (6.1) 
Prom properties of the Snell envelope and at time t = the system is in mode 1, we have: 
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^o' = E[J^' e-^'i^i {Xs)ds + e-'^-i* max {-gij (X.. ) + Y^, )] 
Now from Lemma 2 and the definition of t| we have: 

It implies that 
Therefore 

Jo 1 12 2 

since between and (resp. rj* and r|) the production is in regime 1 (resp. regime Ur*) and then 
ut = 1 (resp. ut = u^-*) which implies that 

r e-''^{Xs,Us)ds = r e~'''MXs)ds+ P e'^V^., 
Jo Jo Jt* 1 

Now repeating this reasoning as many times as necessary we obtain that for any n > 0, 

Yo' = E[ e-''i;{Xs,ns)ds- V e-'-^^<7«.. ^^,{Xr*J + e-'^-Y^-]. 

In ^ — ' fc — 1 k ^ ^ 

•^'J l<fc<n 

Then, the strategy {6*,u*) verify E[^^^q e^^'^"] < +oo, otherwise Yq would be equal to — oo 
contradicting the assumption that the processes belong to 5^. Therefore, taking the limit as n — > +oo 
we obtain Yq = J{6*,u*). 

To complete the proof it remains to show that the strategy {6* ,u*) it is optimal i.e. J{5*,u*) > J{6, u) 
for any {5, u) G V. 

The definition of the Snell envelope yields 

> E[f;^' e-^'iPi (Xs)ds + e-^-^ max {-g^j {X^, ) + Y^ )] 

> E[f;^' e--'^MXs)ds + e— (^n) + YrT')]- 
But, once more using a similar characterization as (j6.ip . we get 

e~rr,Y^n > e-^'iPur, iXs)ds + e---2 j^^x (-5 -(X.J + Yl)\Tr,] 

> E[^ e— V.., {Xs)ds + e— H-5n.,«., (Xr,) + Y:';')\J^^,]. 
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Therefore, 

l^o' > Vi {Xs)ds - e-'-^giu.^ (X,, )] 

Repeat this argument n times to obtain 

l<A;<n 

Finally, taking the limit as n ^ +00 yields 

/>+oo 

•'^ k>i 
Hence, the strategy (5* , u*) is optimal. We proceed to the proof of Lemma 2. 
Proof of Lemma 2. From p.3p we have for any i £ I and t > 

e-'^^Yl = ess sup,>tS[/; e-^«V'*(^.)ds + e"''- max (-5^ (X,) + y' jl-^t]. (6.2) 

This also means that the process (e~^*Y^* + Jq e~''*^/'j(Xs)(is)j>o is a supermartingale which dominates 

( /* e-''UXs)ds + e-^* max (-5ii(Xt) + y/))t>o. 

This implies that the process (IL[„^^=j] (e~^*y/ + f^, e~^'^'ilJi{Xs)ds))t>T* is a supermartingale which 
dominates 

(l[n .=i]( / e''^"V*(^s)(is + e"''* max(-5y(Xt) + y/))t>r*. 

Since T is finite, the process (X^^gj l[u^,=i] (e~^'*y/ + e~'^^il)i{Xs)ds))t>T* is also a supermartingale 
which dominates (Y^iei ^[u^*=i]if^* e-'"^'ipi{Xs)ds + e"''* max (-5tij(Xt) + y/))t>^.. 

Thus, the process {e~^'^Y^ + J^, e~'^'^ipu^* {Xs)ds)t>T* is a supermartingale which is greater than 



( /* e-'^^^^. {X,)ds + e-''-' max (-5«,.j(Xt) + y/))t>.*. 

To complete the proof it remains to show that it is the smallest one which has this property and use 

the characterization of the Snell envelope see e.g. [7} 114^ [T6]. 

Indeed, let {Zt)t>T^ be a supermartingale of class [D] such that, for any t > t^, 

ft 



Zt> [ e-^>„^.(X,)ds + e-'-* max (-5 -(Xt) + y/). 
It follows that for every t >tI, 

1k*-]^* ^ 1k.-]( /* e-^^MXs)ds + e-^' max(-5.,(X0 + y/)). 
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But, the process (l[„^^=j]Zt)t>^* is a supermartingale and for every t>T^, 

lK*=i]e-'-*l^/ = ess sup,>,£;[a[„^_,]( e— + e"''^ max.(-5i,(^r) + Y^))\J^t]. 
It follows that, for every t > r]*. 

Summing over i, we get, for every t > Ti, 

Zt > e-^'Y^^* + f e-''ij^AXs)ds. 

Hence, the process {e^''^Y^ + J^* e'''^'^'i}:u^t{Xs)ds)t>T* is the Snell envelope of 
(/ e-^^V«,.(X,)ds + e-''* max (-5„^,j(Xt) + F/))t>^* , 

whence Lemma 2.n 
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